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Multi-megaton scale under ice and underwater detectors of atmospheric neutrinos with few GeV's 
energy threshold (PINGU, ORCA) open up new possibilities in the determination of neutrino prop- 
erties, and in particular the neutrino mass hierarchy. With a dense array of optical modules it 
will be possible to determine the inelasticity, y, of the charged current events in addition to the 
neutrino energy E v and the muon zenith angle 0^ . The discovery potential of the detectors will sub- 
stantially increase with the measurement of y. It will enable (i) a partial separation of the neutrino 
and antineutrino signals; (ii) a better reconstruction of the neutrino direction; (iii) the reduction of 
the neutrino parameters degeneracy; (iv) a better control of systematic uncertainties; (v) a better 
identification of the events. It will improve the sensitivity to the CP-violation phase. The three 
dimensional, (E u , O^^y), ^—oscillograms with the kinematical as well as the experimental smearing 
are computed. We present the asymmetry distributions in the E u — 0^ plane for different intervals 
of y and study their properties. We show that the inelasticity information reduces the effect of 
degeneracy of parameters by 30%. With the inelasticity, the total significance of establishing mass 
hierarchy may increase by (20 — 50)%, thus effectively increasing the volume of the detector by factor 
1.5-2. 

PACS numbers: 14.60.Pq 



I. INTRODUCTION 

Multi-megaton scale atmospheric neutrino detectors 
with few GeV's energy threshold have an enormous and 
largely unexplored physics potential. These detectors are 
sensitive to the oscillatory patterns due to the 1-3 mixing 
in the neutrino energy - zenith angle (E V — V ) plane. The 
patterns have several salient features, which include the 
MSW resonance peaks due to oscillations in the man- 
tle (E u ~ 6 GeV) and the core (E v ~ 4 GeV) as well 
as the parametric enhancement ridges at E v ~ (4 — 12) 
GeV which are realized for the core crossing neutrino 
trajectories (see [I] for detailed description and [2] for 
recent review and references). The patterns differ for 
neutrinos and antineutrinos and strongly depend on the 
type of neutrino mass hierarchy. In particular, the in- 
dicated features appear in the neutrino channels in the 
case of normal mass hierarchy (NH) and in the antineu- 
trino channels in the case of inverted hierarchy (IH) (in 
the two neutrino approximation, inversion of the mass 
hierarchy is equivalent to switching the neutrino and an- 
tineutrino oscillation patterns). This opens up a possi- 
bility to establish the neutrino mass hierarchy and also 
to measure the deviation of the 2-3 mixing from maximal 
as well as the 1-3 mass splitting. Once the hierarchy is 
established, one can consider a possibility to measure the 
CP-violation phase. 

Multi-megaton detectors are expected to record of the 
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order of 10 5 events a year. Such a large statistics allows, 
in principle, to compensate shortcomings related to flavor 
identification of events and reconstruction of their energy 
and angular characteristics. With so high statistics, one 
can select some particular events in certain kinematical 
regions, which are most sensitive to a given neutrino pa- 
rameter, thus reducing effect of degeneracy of parame- 
ters, etc. 

PINGU (Precision IceCube Next- Generation Up- 
grade) [3 , the IceCube DeepCore [4 augmented with a 
denser instrumentation in its center, and ORCA (Oscil- 
lation Research with Cosmics in the Abyss) [5] projects 
are possible future realizations of these Multi-megaton 
scale detectors. 

A simplified estimation of the sensitivity to the mass 
hierarchy of the DeepCore (DC) experiment has been 
performed in [6 j. Due to the high energy threshold (> 10 
GeV), DC has a low sensitivity to the resonance pattern 
and therefore to the hierarchy. The sensitivity of DC 
to deviation of the 2-3 mixing from maximal has been 
explored in [7]. 

The idea to send a neutrino beam from Fermilab to 
PINGU to determine the mass hierarchy has been elab- 
orated in [8]. 

A possibility to use PINGU and the atmospheric neu- 
trino flux for the identification of the neutrino mass hier- 
archy (MH) and search for the CP violation effects was 
recently explored in [9 . The strategy is based on the 
measurement of the E v — V distribution of the sum of 
muon neutrino and antineutrino events. The smearing 
of the distribution over V and E v has been performed 
that takes into account accuracy of reconstruction of the 
neutrino energy and direction. 
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The estimator of discovery potential, S (the hierarchy 
asymmetry) , has been introduced [9] , which allows one to 
make quick evaluation of sensitivities of the detector to 
neutrino mass hierarchy as well as to other parameters. 
For r/'-bin in the reconstructed neutrino energy (i) and 
zenith angle (j), the asymmetry is defined as 



N m - 



jVNH 



(v) the sample of events is contaminated by con- 
tributions from v T and v e charged current (CC) interac- 
tions and neutral current (NC) interactions of all neu- 
trino species. In particular, v T 's generated via oscilla- 
tions produce tau leptons, which decay in 18% cases into 
muons, thus appearing as events. Also v e and NC 
interactions can mimic events due to muon - pion 
misidentification. These events produce an additional 
effective smearing of the oscillatory pattern. 



Here and are the numbers of events in the 

ij-bin for the normal and the inverted mass hierarchies 
correspondingly. The moduli of the asymmetry, JS^r/l, 
gives the statistical significance for the identification of 
the mass hierarchy. The asymmetry allows one to ex- 
plore in a transparent way the dependence of sensitivi- 
ties on the experimental energy and angular resolutions, 
on degeneracies of parameters and on various systematic 
errors. In [9] it was shown that the hierarchy can be es- 
tablished at (3 — 10)<j level after 5 years of operation of 
PINGU depending on the energy and angular resolutions 
and on the size of the systematic error. 

A final answer concerning the sensitivity should follow 
from the detailed Monte Carlo simulation of the distri- 
butions of events. That should take into account realistic 
parameters of the detectors after their geometries are de- 
termined. Then, in a simple approach, the sensitivity can 
be obtained from the fit of the simulated distributions 
with the distributions computed for the cases of normal 
and inverted mass hierarchies. The fit can be done us- 
ing Poisson statistics without binning. Results of a "toy" 
Monte Carlo study for large volume detectors have been 
presented in [10 . The physics potential of PINGU and 
ORCA was further explored in [11] and [TO] . 

As it was discussed in [9] , several factors dilute the sig- 
nificance of the MH identification, although at the prob- 
ability level the effect of inversion of the hierarchy is of 
the order 1. Indeed, 

(i) the hierarchy asymmetry has opposite signs in dif- 
ferent kinematical regions. Therefore smearing over the 
angle and energy, E v — Q v , leads to a substantial de- 
crease of the observable effect. The smearing originates 
from finite energy and angular resolutions of the detec- 
tor (experimental smearing) and due to difference of the 
neutrino and muon directions (kinematical smearing); 

(ii) the hierarchy asymmetry has different signs for 
neutrinos and antineutrinos. Therefore summing up the 
neutrino and antineutrino signals leads to a partial can- 
cellation of the effect; 

(hi) the presence of both v ^ and v e flavors in the origi- 
nal atmospheric neutrino flux leads, in general, to a sup- 
pression of oscillation effects. The suppression becomes 
weaker at high energies, where the v e flux is small; 

(iv) current uncertainties of the oscillation parameters, 
such as Am^ and #23 further reduce identification power, 
since the effect of inversion of the mass hierarchy can be 
partly mimicked by changes of these parameters; 



All this renders the quest of the neutrino mass hierar- 
chy difficult. Some (probably modest) developments of 
technology are required. This includes the selection of 
certain geometry of the detector, the upgrade of the op- 
tical modules, further developments of the time analysis 
of events, etc. On the other hand, some particular ways 
to analyse the information obtained can also improve the 
sensitivity. 



In this connection, we explore improvements of the sen- 
sitivity to the neutrino MH due to the measurement of 
the inelasticity, y « 1 — E^j 'E V1 of the charged current 
events. As we will show, this new ingredient in the 
analysis enables us to alleviate some of the problems men- 
tioned above. In particular, it allows to effectively sepa- 
rate the and signals, and thus to reduce the partial 
cancellation of their contributions to the MH asymmetry. 
The idea was mentioned in [12]. Using the inelasticity 
will also allow to reduce kinematical smearing effect and 
degeneracy of parameters. It will lead to a better flavor 
identification of the v ^ events. 



The paper is organized as follows. In Sec. [H] we de- 
scribe the events, their detection characteristics, rele- 



vant kinematics and cross-sections. In Sec. |III[ possible 
improvements of the sensitivity to the mass hierarchy and 
other neutrino parameters due to the inelasticity mea- 
surements are discussed. In Sec. [TV] we compute the 
three dimensional distributions of events in the recon- 
structed neutrino energy, E v , the muon zenith angle, 9 ^ , 
and y variables, which take into account the kinematical 
smearing. We explore the properties of these 3D distri- 
butions and find the corresponding hierarchy asymmetry 
plots. In Sec. [V| we present results of smearing of the 
distributions over the finite experimental resolutions of 
observables: the muon and hadron cascade energies and 
the muon angle. We then compute the total significance 
of identification of the mass hierarchy, and its dependence 
on possible accuracy of measurements of the energies and 
angles (experimental smearing). We estimate how mea- 
surements of inelasticity reduce the effect of degeneracy 
of the mass hierarchy and mass splitting Am^. Sec. VI 
contains discussion of the results and outlook. 
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II. is u EVENTS AND INELASTICITY 



This gives 



A. events 

In this paper we concentrate on the events induced 
by the charged current weak interactions: 



(1) 



where h refers to the hadron system in the final state. 
Observables associated to the reaction ([I]) are the energy 
of the muon its direction characterized by the zenith 
and azimuth angles 0^ and and the cascade energy 
(the total energy in hadrons), Eh- 

At the energies we consider, from a few GeV up to 
~30 GeV, the cascade direction is not meaningful on 
an event basis. Indeed, the cascade energy is shared 
in a variable mixture between light mesons and heavier 
hadrons, which leads to a highly random and anisotropic 
Cherenkov photons emission. Contrary to muons, the en- 
ergy release from cascades is approximately "point-like" , 
given the sparsely instrumented detector arrays under 
investigation. 

The reconstruction of the v ^ event consisting of 
recorded photons (hits) from the combined emission from 
a vertex shower and a muon track in this case, can be per- 
formed well at low energy using prescriptions in [13 . The 
visible cascade energy, the muon track length (i.e. its 
energy) and incoming muon direction can be extracted. 
Moreover, the impact of the short scattering length of 
Cherenkov photons for a dense detector in ice is expected 
to be rather mild as it will be argued later. As most 
hits are undelayed, a good reconstruction accuracy of the 
muon incoming direction as well as a clear separation of 
the shower and muon signatures are expected. 

Thus, the set of observables # M , (/> M , consti- 
tutes a rather exhaustive description of the CC in- 
teraction. The original neutrino energy is determined 
through 



E v = E h + E fl - m N , 
where tun is the nucleon mass. 



(2) 



B. Inelasticity and kinematics of the process 



The inelasticity y is defined as 



y ^ 



Ey — E^ 

E v ' 



(3) 



Let us consider the angle between the neutrino and the 
produced muon, /3. The square of the transfer momen- 
tum, q 2 , equals 

q 2 = (Pu-P^) 2 = -VEviEp - |p M | cos/3) + ra£, 

so that Q 2 = —q 2 equals 

Q* = 2E v E»(l-^co S ^-ml. 



cos /3 



3l 
IpmI 



i 



Q 2 



2E 1 ,E i 



(4) 



In terms of the Bjorken variable 

n2 n2 



x = 



2(p N q) 2m N (E u -E fI 



we have 



Q 2 = 2xym N E v , 

where we used Insertion of this expression into Q 
gives 



Q ^1* 

cos p — - — ^~ 
IPmI 



2xym^E v 



2E v E Ui 



(5) 



Notice that with decrease of p M , cos /3 
0,1. We can rewrite ([5| as 



±1 when x 



cos/3 = 1 - 2xy((E u ,x,y), 



m,, 



where 

C(E u ,x,y) 

Here E^ = E^{E V , y) and p M = 
m M , we obtain neglecting m M 



• 2m N E v xy - 2E v (E yL - |p M |) 



±E v xy\vv\ 

= p^(E u ,y). If p M « En > 



m N 
2E n 



Let us find the limits in which cp = 
Varying x, we obtain for x = that cp 



cos/3 changes, 
a £„/|p„| > 1, 

so that c™ ax = 1. For not very small |p M | (and we will 
consider |p M | > ttin) the minimal value of cp corresponds 
to x = 1: 



3l 
\p,\ 

E^_ 

IpmI 



2m N (E u -E fl ) 



- m u 



2E v Eu 



2m n 



i 



E, 



(6) 



or sin/3 min /2 - ^ym N /E^. 

For a given muon direction, the neutrino direction is 
determined by the angle /3 and the azimuthal angle <\> 
with respect to the plane formed by the muon momentum 
and axis x. It is straightforward (see Appendix[A| to find 
the relation between the neutrino zenith angle U and the 
muon zenith angle 0^: 



(7) 



where c v = cos^, c M = cos 0^ and = cos</>. 

According to ([7]) for fixed /3 the maximal and minimal 
values of c v correspond to = ±1 and equal 



cos(6> /i - /3), 



:cos(e M + /3). (8) 
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Cross-sections 



and for N^ H one needs to substitute p^ H — ^ Pp H - Here 



In our calculations of Sees. |IVl and [V] we will use the 
deep inelastic scattering (DIS) cross-section only. We 
neglect the contributions of the single pion production 
and quasi-elastic scattering processes. This will lead to 
conservative estimations of sensitivities, as the reduced 
momentum transfer translates into smaller angle between 
the muon and the neutrino directions. In any case the 
relative importance of these processes becomes negligible 
above « 5 GeV, and below « 5 GeV, detector resolutions 
and effective volumes are strongly limited. 

The differential CC cross-sections of the v and v DIS 
on an isonucleon N=^(n+p) equal 



d 2^CC 



\ G 2 F m N xE u 



dxdy 

x[(q + s - c) + (1 - y) 2 (q - s + « 

dV? c 



(9) 



-(Ev,x,y) = 



G F m^xE u 



dxdy 7r 

xi(q-s + c) + (l-y) 2 (q + s-c)}, (10) 

where q = u + d + s + c, q = u + d + s + c and the 
quark densities u = u(x,Q 2 ), etc., are described by the 
CTEQ5 parton distribution functions in the standard MS 
scheme [14], valid down to Q 2 « 1 GeV 2 . 

The limits of x— integration of the cross sections are 
in the interval {x m i n ,x max } = {%(c(3 = an d 
integration runs from to y max = 1 — m^/ E v . 

Integrating the cross-sections ([9| and ( fToj ) over x we 
obtain 



d<J 



CC 



dy 



[-ao - ai(l - y) 2 ] 10_38cm2 fG^ 



dy 



h&o-Mi-y) 2 )] 10_38cm2 rG^v 



where a 0.72, a x 0.06, 6 0.09 and b x = 0.69. 
Then the normalized inelasticity distributions equal 



1 dcr v ^ ap + ai(y - l) 2 
dy a + ai/3 

^da^ _ fro + fri(g/-l) 2 
<j p dy 6 + h/3 



(11) 
(12) 



Here, we have dropped the very weak ^—dependence in 
the range of interest and considered the limit m M — >• 0. 



= 2nN A n ice V e zTa cc <S>l 



p* H = 2nN A n ice V e vTa cc $l 



In (13, 14) 



<z>NH 
pNH 



$0 



, (13) 
• (14) 



are the flavor ratios, where <1>^ = $^(1^,0^) are the 
neutrino fluxes at production; P^r 1 an d are the 

^« oscillation probabilities for neutrinos and an- 

tineutrinos. V e ^(E u ) is the effective volume of a detector, 
Pi ce is the ice density, Na is the Avogadro number, and 
T is the exposure time. 

For the effective mass of the detector we take [9 

PiceKff(^) = 14.6 x [log^/GeV)] 1 ' 8 Mt. 

We keep the same effective volume as in [9 in spite of 
several recent re-evaluations for two reasons: (i) for easier 
comparison of results with those in [9] and some other 
publications, and (ii) because the final configuration of 
the detectors are not yet determined. If the effective 
volume (which also depends on the criteria of selection 
of events) is reduced by factor 3-4, the significance for 
the same exposure period will be reduced by factor 1.7 - 
2.0. 

Expressions for the inverted mass hierarchy is obtained 
with substitution NH — » IH. Recall that in the 2v approx- 
imation, when effects of 1-2 mixing and mass splitting are 
neglected, there are relations between the probabilities 
for normal and inverted hierarchies 



r)NH 

a(3 



rylH 

■ a(3 j 



a(3 



a(3 ■ 



(15) 



That is, an inversion of the mass hierarchy is equivalent 
to switching neutrinos and antineutrinos. In the three 
neutrino mixing context, the relations (15) are not exact 
(see, e.g., Fig. 2 in [9]), especially for the core crossing 
trajectories. 



III. IMPACT OF INELASTICITY 
DETERMINATION. QUALITATIVE PICTURE 

A. Inelasticity and separation of neutrino and 
antineutrino signals 



D. Number of events 

The number of neutrino and antineutrino events in the 
case of NH, N^ H and N^ H in a given ij— bin of the size 
A^cos^, AjE u equals 

N? H = I dcos^ f dE v p™ H {E v ,cos0 v ), 

Mi cos^ J AjE„ 



The hierarchy asymmetries in the neutrino and an- 
tineutrino channels have opposite signs. In fact, in ex- 
pressions for the difference of numbers of events for NH 
and IH (see [9 ) all the terms are proportional to the 
factors (1 — and (1 — ft e ), where 

_ a cc 4>° 
K ^ = a cc<$>o 
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is the ratio of cross-sections and fluxes of the muon an- 
tineutrinos and neutrinos at the production, and n e is de- 
fined similarly. The ratios and n e depend on neutrino 
energy and direction and equal approximately 0.4 — 0.6. 
The v and v contributions to the number of events par- 
tially cancel each other. So, in this case the MH de- 
termination relies on the non-equal v and v fluxes and 
cross- sections. The separation of the neutrino and an- 
tineutrino signals allows to further reduce the cancella- 
tion and therefore to enhance the significance. As follows 
from Eqs ([TTJT2J) , the average value of y is 50% larger for 
v than for v. Therefore we can use the inelasticity to 
separate the v and v signals. 

One possible procedure is to determine for each bin (a 
large number of events will allow to do this) the frac- 
tion of neutrino and antineutrino events by fitting its 

distribution: 

1. Select small enough bins in neutrino energy - zenith 
angle plane, so that the oscillatory structures due to cer- 
tain mass hierarchy are not averaged out (the bin size 
should be eventually optimized). The number of neu- 
trino and antineutrino events in each bin equals 



Np = Na N v =N(l-a), 



(16) 



where a is the fraction of antineutrino events and we have 
omitted the bin indices. 

2. Measure the y— distribution of these events. 

3. Fit the measured distribution with 



p u p(y, a) = (1 - a)p v (y) + ap p (y), 



(17) 



where p v {y) and pp(y) are given in (11) and (12), thus, 
determining the fraction a. 

A possible enhancement of the sensitivity to the hier- 
archy due to the separation of the v and v signals can 
be estimated in the following way. In the described pro- 
cedure there are two independent observables: the total 
number of events, N = N v + Np, and a extracted from 
the ^/-distribution with the accuracy 5a. In general, 



5a 



1 

AT 



(18) 



where 7 = j(a, N). The error 5a can be estimated using 
the method of moments. As we have two parameters, a 
and 5a, to extract, it is sufficient to calculate the first and 



second y- moments of p v p{y 1 a) given in Eq. (17). Using 



expressions (11-12), we obtain the average inelasticity 

(y): 

(y(a)) = J yp u p(y, a)dy w 0.494 - 0.174a. (19) 

The mean deviation <j| = ((y — (y)) 2 } of the average y 
value after N measurements from the true value (y) is 



(jy{a,Nf 



N 



N 



y 2 Pvp(y,a)dy - (y(a)Y 



N 



(0.084 + 0.010a - 0.030a 2 ) . 



(20) 



From Eq. (19) and following a measurement of y, we 



obtain a measured value a. The average value 5a is given 

by 



5a = \J ((a — a) 2 ) 



V((y-(y)y 

0.174 



5.75 A /cr|. (21) 



Substituting aj from Eq. (20), we obtain 

5a(a, N) « -j= y/l + 0.115a - 0.362a 2 , (22) 



N 

where 7 = 1.66. 

If a is not close to 1 (for all practical purpose a < 0.5), 
5a weakly depends on a and we can use Eq. (18). 



A detailed investigation of Sa(a,N) by means of 
the maximum likelihood method confirms the estimate 



Eq. (22) for large N. For N < 100, this method shows a 



slight improvement with increasing a with respect to the 
method of moments. It is worthwhile to further explore 
this approach. 

Let us find the errors a,, and cr D in the determination 



of N v and Np. According to Eq. (16), variations of N v 
can be written as 



5N U 



(1 - a)5N - N5a = (1 - a)VN - N5a. 



The variations 5N and 5a are independent and therefore 
they sum up squared: 

a 2 = (l-a) 2 N + (5a) 2 N 2 , o% = a 2 N + (5a) 2 N 2 . (23) 

Assuming that the measured quantities TV and a are re- 
spectively distributed according to Poisson with mean N 
and Gaussian with mean a and standard deviation 5a, 
the exact variance calculation of N v ^(a,N) leads to the 
same result as in Eq. (23), provided that N ^> 7 2 . 



Using (18), we have for NH 



v/(l-a) 2 + 7 2 , 



\/ a 2 + 7 2 . 



(24) 

The hierarchy asymmetries in the neutrino and an- 
tineutrino channels can then be written as 

n ih _ n nh N- H - N^ H 
S v = Sp = (25) 



Here we assume that NH is the true hierarchy and there- 
fore corresponding number of events is what is measured. 

If Sp and S v are independent, the total significance 
equals 



sm = ^si + sl. 



It can be rewritten using Eqs. (25) and (24) as 

1 l(Nl H -N? H ) 2 (Nl H - Nj? H Y 



5totP v / iV^V (l-") 2 +7 2 



a 2 + 7 2 
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For the significance without v 
have 



v separation we would 



Stotl — 



IH 



IH 



NH 



NH 



^NH 



Therefore the enhancement factor R = S tc % / 1 S to t | due to 
separation of the neutrino and antineutrino signals equals 



R 



Here 



and 



1 



1 



■r 



K^fp Va 2 + 7 2 V (1 - oi) 2 + r 



(26) 



ff 



pNH 

MM 



IH 



NH 



Nl H - N* H ' 



pIH 

MM 



1 (pNH _ pIH\ 

r V e/x e/x J 



p/# _ pNH I 1 (p/H _ piVi^ 
/i/i /x/x ~ r- V e/x e/x / 



If r = r, in the 2^ approximation we would have f P = l. 

In Eq. (26) the minus sign in the denominator of the 
first factor reflects the partial cancellation of the hier- 
archy asymmetries from the neutrino and antineutrino 
channels. The second factor describes the reduction of 
enhancement due to the error in the separation of the 
neutrino and antineutrino signals. The expression is valid 
if a is not very close to or 1. 

Notice that the enhancement factor R does not depend 
explicitly on the number of events. The number of events 
is mainly encoded in K^fp and in 7. The value of a 
changes from bin to bin. For a = 0.50 (0.32), = 0.4 
and f P = 1 we obtain R = 1.05 (1.01). 

The enhancement factor is very close to unity. How- 
ever, a slight improvement on the determination of 7 
leads to a substantial increase of R. A 10% decrease 
of 7 leads to R = 1.15 (l.lOjfor a = 0.50 (0.32). 

Notice that according to (25), the ratio 



Sp 

s v 



is negative and v and v asymmetries have opposite signs. 
For ideal separation, 7 = 0, we would have 



R 



1 



1 



1 - Kfifp ol V (1 - a) : 



It gives R = 3.6 (3.2) for a = 0.50 (0.32). This number 
can be considered as the maximal possible enhancement. 

Notice that the estimations presented above differ from 
the estimations in the case in which the numbers of v ^ 
and events are measured independently (in our pre- 
vious consideration these numbers correlate). In the lat- 
ter, a v = \ZTn\s, Gy = \^Np and the enhancement factor 
equals 



R 



1 



1 



a 



a 



If fp = 1 and « 0.5, we obtain R = 2.4 for a = 0.32 . 

The above estimations have been done for a single bin 
and one should average the enhancement factor over all 
the bins. Since R depend weakly on iV, the estimation for 
a ~ 0.5 give good idea about the overall enhancement. 

Notice that the weak enhancement factor we obtain is 
due to the error of the separation parameter, 8a. This is 
confirmed by exact computations in Sec. |V[ 



B. Inelasticity and reconstruction of neutrino 
direction 



The dominant source of sensitivity loss for the deter- 
mination of the neutrino mass hierarchy follows from the 
angular smearing of the oscillograms [9], and in particu- 
lar, the kinematical smearing due to the angle between 
the neutrino and muon directions. Indeed, according to 



/3 



m N xy 
2E„ ' 



(27) 



From this relation with (x) ~ 0.3 we find that the average 
angle which characterizes the kinematical smearing is 



0.75 



V%/GeVV 1 ~y 



y 



(28) 



Then for the average values y v g 0.5 and 
y D « 0.3 it equals ((3„) « 0.75/vX/GeV and 
(f3p) ~ 0.5/ \/ E u / GeV . Using these estimations we find 
that Acj, is larger than the region of the same sign 
hierarchy asymmetry for E v < 6 GeV. 



According to (27), interactions with small y correspond 



to small scattering angles. Thus, the selection of events 
with small y reduces the interval of possible values of 
/3. For instance, for a sample with y < 0.3, the aver- 
age inelasticity is about (y) ~ 0.14. Then according to 
(28) the average angle between the muon and neutrino 
incoming directions equals (0) w 0.13/ vX/GeV. The 
sample however retains about 30% of neutrino and 55% 
of antineutrino events, thus having lower statistics. 

At small y, the angular reconstruction error of the 
muon itself is small, as the muon carries most of the 
neutrino energy and there are less hits from the cascade, 
which otherwise worsen the reconstruction of the muon 
direction. 

However, at small the difference of cross-sections 
of neutrinos and antineutrinos becomes smaller (they 
are equal at y = 0). Therefore the separation of the 
neutrino and antineutrino signal becomes difficult, and 
the cancellation of neutrino and antineutrino signals in 
the hierarchy asymmetry becomes stronger. 

For large y, on the other hand, the contribution of v is 
strongly suppressed, which eliminates the v — v cancel- 
lation. But for events with large y the reconstruction of 
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the neutrino direction is very poor. Furthermore, identi- 
fication of the v ^ events becomes difficult (see below). 



high. The reaction favors events with higher tt multiplic- 
ity rather than events with higher ir energies. 



C. Inelasticity, systematic errors and degeneracy of 
parameters 

In [9], the method is mainly based on the differential 
measurement of the neutrino-induced muon flux from dif- 
ferent incoming directions and at various energies, avoid- 
ing some sources of systematic uncertainties (especially 
the correlated ones). The approach adopted in this pa- 
per goes a step beyond with the additional sensitivity to 
the - admixture or y providing the method an even 
stronger immunity to sources of systematic uncertainties. 

The degeneracy of the neutrino parameters reduces sig- 
nificantly the sensitivity to the mass hierarchy [9 . The 
problem may be alleviated, but not avoided, in the fu- 
ture by more precise measurement of neutrino parame- 
ters in MINOS, T2K, NOvA and in reactor experiments. 
The use of inelasticity in analyses will reduce the impact 
of degeneracies. Indeed, effects of uncertainties, e.g. in 
Am 2 2 and #23 , are nearly the same for v and while 
the ^/-distributions for v and v are different. Therefore 
measurements of inelasticity will allow to somehow sep- 
arate effects. A quantitative study of the corresponding 
improvements will be given in Sec. JV) 



D. Inelasticity and identification of events 

As discussed in [9 , tau neutrinos contaminate the 
sample by about 5% contribution. Oscillation effect on 
this contribution differs from the one on the true v ^ 
events. This leads to a kind of additional smearing, 
which cannot be neglected. The inelasticity observable 
enables us to further suppress the number of v T — >• \i 
events in a sample because of the specific vertex kine- 
matics of tau neutrino interactions: Rather large showers 
are produced and the angle between the muon and tau 
neutrino is large, as the muon is sharing energy with two 
other neutrinos. Therefore this class of events has in av- 
erage rather large effective y, and restricting an analysis 
to small y will allow to disentangle at least partly the v T 
contribution. Quantitative analysis of this suppression is 
beyond the scope this paper. 

For large y, due to the low energy of muon, the prob- 
ability of misidentification of the events with the CC 
v ejT events as well as the NC events of all neutrino species 
becomes large. Indeed, there can be confusion between 
the charged pion and muons as they both have a long 
decay length (X 7r ± ^ 56 m at 1 GeV) and propagate with 
low energy loss rate (the dominant ionization energy loss 
limits their range to < 5m per GeV). However, the en- 
ergy distributions of muon and pions strongly differ: the 
simulation with GENIE [15] of 10 GeV interactions 
shows that the most probable E n ± is of the order of a 
few 100's MeV, so that E n ± « 1 GeV is already unlikely 



IV. 3D - DISTRIBUTIONS AND 
OSCILLOGRAMS 

As we saw in the previous section the separation of the 
neutrino and antineutrino signals requires measurements 
of the y— distribution in a wide range of y, and especially 
for large where the difference of the neutrino and an- 
tineutrino cross-section is maximal. On the other hand, 
good reconstruction of the neutrino directions requires se- 
lection of events with small y. In a sense, improvements 
of the sensitivity due to v — v separation and narrowing 
the angular distribution are incompatible. Small y are 
preferred also for the identification of the events and 
the disentanglement of the from v e ^ T events. There- 
fore, one expects that the best sensitivity to the neutrino 
mass hierarchy is for the intermediate range of y. Here 
the interplay of different effects occurs, which requires 
a combined description using the differential character- 
istics in y and also in x since the angle depends on x 
too. 



A. Densities of events. Oscillograms for different y 

The density of the events as function of E v , c M , y 
equals 



(E v ,c^y) 



1 

2^ 



dcs 



d °v Pv \Ey,Cy) 

dcpdy rf c {E v ) ' 



where p^ H is defined in (13); c v is given in (m), and the 
lower limit of integration, c™, is defined in (pk. Similar 
expressions can be written for antineutrinos and for the 
IH case. 

Using the relation Eq. (|7|), we change the integration 
variables, d(j) — » dc v : 



1 pi d 2 cr cc 
^ H {E y ,c^y) = - / dcp—^-(x(ce),y) 
7r J c min dcpdy 

x / dc v 9v 



(29) 



Here 



and 1 / y/h, is essentially the Jacobian of transition to new 
variables according to ^ . The limits of integration c™ ax 
and c™ m will be specified later. Notice that appearance 
of an additional factor 2 in the expression (29) is due to 



twofold ambiguity at the transition from <j> to c v . 

Let us make another change of the integration variable: 
cp —> x. Using the equality 



2^CC 



2^CC 



dcpdy 



dcs 



dV 



dxdy 



dx, 
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we obtain from (29) 



n J J H (E u ,c^y) 



dx 



dc. 



dxdy 



Here £ m in,max correspond to the values c^{E Vl x 1 y) = ±1. 
In turn, the limits of integration over c v correspond to 
h = 0, i.e. to the borders of the interval of the positivity 
condition: h > 0. Indeed, the expression for h can be 
rewritten as 

h = -\c v - cos(0 M - (3)} x [c v - cos(6> M + /3)], 

where /? = (3(x, y, E v ) is determined in Eq. Q. Then the 
limits c™ ax = cos(<9 /i - 0) and c™ in = cos((9 /i + f3) follow 
immediately. 

Changing the order of integrations over x and c#, we 
obtain 



nT(E u ,c„y) = - [ 
n J\t 



Ac v p^{E v ,c v ) 

\e»-e v \<p 
x g v {E v ,y,c v ,c ll ) , 



(30) 



where 



i r"" 



dx 



dxd?/ 



(31) 



Here sp and c# are functions of E v , x and ?/. The function 
g v does not depend on the mass hierarchy and essentially 
play the role of the kinematic smearing function. 

Writing similar expressions for IH and ^, we obtain the 
densities of the events for NH and IH: 



NH,IH/ 



{E„, c M , y) = n™> m {E v , c M , y) + nT^{E v , c M , y) 



NH.IH / 



-f 



,|<A> 



dc„ [p^ H ' IH (^,c zy )^(£: zy ,?/,c l ,,c /i ) 



Let us find the limits of integration over x in Eq. (31). 
According to Eq. ([5| 



2E V (E^ - \pp\cp) - m 



2m N E v y 

which imposes the lower and upper bounds to x: 

x ± = x(cos (0 V ± 

For a given 0^ and the minimal angle between the 
muon and the neutrino is /3 = — Q v \. The maximal 
angle j3 is given by cp iinax = cos (6 U + M ). 

The integration over in Eq. (30) runs from cos(^ /i + 
/8 ) to cos(<9 M - /Sq), where c^ = cp(E v ,x = l,y) and 
M ± /So is restricted by the interval — 7r. 

B. Kinematical smearing function 



According to Eq. ( [30] ), the functions g v ^[E v ^y^c v ^c^) 
;idered 



in (31) can be considered as the smearing functions over 
the neutrino angle. Fig. [I] shows dependence of g v and 
gp on c M for several values of c v and y. 
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2/jCi/jfy)! . (32) 



Introducing p NH = 
pression in (32) as 



Pu 11 + P^ H 5 we can rewrite the ex- 
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dcp^^.c) G(E 



\e»-e u \<p 



where 



G{E UJ y, C^, C^) = pNH ~^ ^^NH ' 

The function G can be immediately compared with the 
Gaussian smearing function, which was used in [9] em- 
bedding both kinematic and experimental resolution ef- 
fects. 



FIG. 1: The angular smearing functions for neutrinos (upper 
panel) and antineutrinos (bottom panel) for E u = 10 GeV and 
different values of c u (numbers at the curves). Solid, dashed 
and dotted curves are respectively for y = 0.2, y = 0.5 and 
y = 0.8. 

The smearing functions differ from the Gaussian func- 
tion assumed in [9]. They have two peaks with a local 
minimum in between; there are no exponential tails; the 
central parts are at c M « c v . The asymmetry of the peaks 
becomes stronger with c M approaching ±1; the width of 
the functions increases with y. The functions g are sim- 
ilar for neutrinos and antineutrinos. As expected, for 



9 



antineutrinos the overall normalization decreases with in- 
crease of y, whereas for neutrinos normalization changes 
weakly. 

The properties of g v ^ can be readily understood from 
the expression for h. Indeed, g v ^ have inverted (and 
also smoothed) shapes with respect to that of y/h. In 
particular, peaks of g v ^ correspond to zeros of h, the 
minima of g v ^ correspond to the maxima of /i, etc.. 

The function h can be rewritten as 

h = s 2 p-(cl + c\) + 2c v c^cp, 

which is obviously symmetric with respect to the inter- 
change 



As a consequence, g UyP also obeys this symmetry. 
Introducing 

r 2(xy = 2 sin 2 ^, 

we can present h as 

h = 2r(l - c v c^) - r 2 - (c v - c M ) 2 . 

Then defining the difference A = c v — c M , we have 

MA)= 5 2 (2r-r 2 )-(A + r C/i ) 2 . 

So, h, as function of A, is an inverted parabola with 
its maximum shifted to A = — rc M . In agreement with 
Fig. [I] h(A) is not symmetric with respect to A = or 
c-v — C/x, and the minimum of g v ^ is shifted with respect 
to c M = c v . This also leads to difference of heights of 
peaks. 

Zeroes of h are at 



According to (|8| in terms of angles the zeros of h are given 
by cos 6^ = cos(^ /i ± /?). So, the width of the smearing 
function increases with f3. In turn, according to ( [28] ) ? 
j3 oc yjy, and consequently, the width increases with 
as we mentioned before. 

It is easy to understand the appearance of peaks in 
9u,u(cu) at the borders of allowed interval using the fol- 
lowing graphical representation. The neutrino vector is 
on the surface of the cone with angle j3 and axis along the 
muon momentum. With change of </>, the neutrino vec- 
tor moves on the surface of the cone. The maximum and 
minimum of c v given by ([8| correspond to the neutrino 
vector situated in the plane formed by the muon vector 
and the axis z and the neutrino vector is moving perpen- 
dicularly to this plane. Therefore around these positions 
the z-projection of the neutrino vector does not change 
appreciably, and so the integration over <j) leads to bigger 
contribution. 



C. Oscillograms for different values of y 

We will use the general formulas obtained in the pre- 
vious sections to compute the oscillograms and asymme- 
try distributions for different values of y. The functions 
p^ ,m (E u , c u ) are taken from [9]. 

Fig. [2] shows the E v — cos 6^ binned distribu- 
tion of the hierarchy asymmetry with the inelasticity 
(^/—dependence) and kinematical smearing taken into ac- 
count. Different panels in this figure correspond to dif- 
ferent y— intervals {y m { n , 2/max}- The asymmetry in these 
intervals has been computed in the following way. We 
first used very small y— bins Ay <C (2/ max — y m in)- We 
computed the asymmetry in each of these small bins 
Sk = S(yk : E u , cos0 M ) and then the total asymmetry in 

the interval {y m im 2/max} as S tot = vT^f ( tne sum runs 
over all small y— bins in the interval {y m in 7 2/max})> and 
the sign is the same as for dominant contribution. In 
practice the summation over small bins was substituted 
by integration: 



max? 

£^,COS 6> ) 



i/min 



-,NH\2 



NH 



1/2 



Here 

n NH,IH ■ 

the number of events in the bin 
AE V A cos Op given in ([32 ) . 

The first panel of Fig7[2 corresponds to {y m { n , 2/max} = 
{0, 1}, the others - to various intervals with t/ ma x-!/min = 
0.2. The first panel is the sum of contributions described 
in other panels. As we see the biggest contribution comes 
from the intermediate region y G {0.3,0.7}. Indeed, at 
small y the hierarchy asymmetry is suppressed due to 
strong cancellation of the nearly equal contributions from 
neutrinos and antineutrinos (recall that at y ~ the 
v and v cross-sections become equal). At large y, the 
asymmetry is suppressed due to strong smearing over the 
angle between muon and neutrino. With the increase 
of the region of strong asymmetry first shifts smaller 
E v and larger cos# M , and then move to larger E v and 
cos 6^ = — 1. The region expands in horizontal (cos# M ) 
direction for small y. 

The total significance (given by integration over the 
first panel with < y < 1) equals 



I St, 



dc M / dE u / dy 



(n 



IH 



,NH\2 



1/2 



(33) 



For exposure T = 1 year, this leads to |Stot| = 8-43. 

If the dependence is not used, the densities of events 
should be integrated over y before computing S. This 



gives 



)) 2 



1 1/2 



J* dy ti- 



ne. 



For 1 year exposure we obtain from (134]) \S i 



(34) 



7.11, 



which is about 15% smaller than in the case when y- 
distribution is used according to Eq. (33). 
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FIG. 2: The hierarchy asymmetry distributions after the kinematical smearing for various inelasticity ranges and for 1 year of 
exposure. 



The following comments are in order: 

(i) The kinematical smearing strongly reduces the to- 
tal significance: for the ideal reconstruction of the neu- 
trino energy and direction we would obtain \S^ D \ = 23.7 



during 1 year even without ^—information. This num- 
ber can be considered as maximal achievable signifi- 
cance. It should be compared with |StStl =7.11 obtained 
from (34). Note that |Stot| = 8-43 can be obtained with 
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an ideal detector having perfect resolutions (see Sec. |V|). 

(ii) The increase of significance by about 15% with 
^/-distribution is better than the one predicted from our 
qualitative discussion in Sec. |III[ using 7 derived from the 
method of moments. This is probably related to the fact 
that the characteristics of the distribution are more 
fully exploited. 

Note also that in our treatment the cross-sections have 
been restricted to the DIS approximation, thus exhibit 
cutoffs at small y, a region of good angular resolution. 
Therefore a more complete description of the cross sec- 
tions will recover the events in the small y— region, fur- 
ther enhancing the significance. 



V. SIGNIFICANCE OF DETERMINATION OF 
MASS HIERARCHY WITH INELASTICITY 

In the previous section we have taken into account the 
kinematical smearing - the integration over the angle be- 
tween the neutrino and muon, /3. Besides this, one should 
perform the experimental smearing over the observables: 
the energy of muon and cascade as well as the direction 
of muon due to finite experimental energy and angular 
resolutions. 



A. Experimental resolution functions 



(n) (t^h = V bE v,hi then 



which has the same form as 07^. We make here a rea- 
sonable simplification that b is the same for cascade and 
muon. In fact, this is true only if we assume that most of 
the energy of the cascade is visible like for a muon. More 
likely, it has a bit smaller Cherenkov photon yield per 
GeV and subject to greater event by event fluctuations. 

In the case (i), we use b = 0.3 in order to compare 
with the results from [9 . In the case (ii), we take b 
in the range 0.35 < b < 0.7, which is derived from an 
estimated number of detected photons n^t/GeV ~ 1 — 
3 [16]. Eq. (26) in [16] predicts nhit/GeV ~ 1.5 for a 
mean distance of about 10 m between the Cherenkov light 
emitter and an optical module of IceCube type. The 
range is extended in the mentioned limits, because the 
precise topology and technology (for instance, the photo- 
detection efficiency and area of the optical modules) of a 
dense array are not yet precisely known. 

We then obtain the energy resolution given by the sta- 
tistical uncertainty of the number of expected hits: 



S(E^ h n hit /GeV) 
n h it/GeV 



{0.35, 1}E^ H ~ {0.6, 1}v^m • 



(36) 



We present here the significance of the identification 
of the mass hierarchy, considering various scenarios for 
the widths a ^ : h(E Vl y) and a^(E Vl y) of the energy and 
angular resolution functions. We use the notation x for 
the reconstructed value of the observable x. 



1. Energy resolution 

We assume the Gaussian energy resolution functions 
of the cascade and muon with widths dh and corre- 
spondingly. Then the neutrino energy resolution is itself 
the Gaussian function (sum of two normal distributions) : 



g Eu (E v ,E v ) 



exp 



1 (E v - E v f 

2 ol 



(35) 



2. Inelasticity resolution function 

The inelasticity distribution g y (E u1 y) can be derived 
straightly from E^ h distributions, g^h(E^ h , E^ h ), de- 
scribed above. We show in the Appendix [B] that it is 
nearly Gaussian in most cases of interests. It deviates 
from Gaussian, showing enhanced tails, when E ^ and Eh 
are both small. In our computations we use the Gaussian 
function with width 



1 



E h 



y/2 \E h + a h + E„-au 



y 



(37) 



Notice that we could perform smearing using immedi- 
ately E^ and Eh without introducing y, and if needed, 
introduce y after smearing. 



with width 



h ' 



which depends on y. 

We consider two cases for the energy resolution of 
muons and cascades: 

(i) (T»,h = bE^ h , which gives a M = bE^ w b(l - y)E v 
and a h = bEh ~ byE Vl so that 



a„(y) = bE u y / l-2y + 2yi 



\ar resolution 



The angle i/j between the true and the reconstructed 
muon directions is described by the normalized distribu- 
tion 



9^ 



2^) 

~Y exp 



V^ 2 



(38) 



which is derived from the 2D Gaussian distribution. The 
interval ip < encloses 63% , and peaks at cr^/^2. 



12 



The width cr^ is generically a function of E^, which has 
the form [13] 



m N 



Here depends on the detector medium (ice, water) and 
its topology. The IceCube detector is sparsely instru- 
menting a medium of relatively short scattering length. 
Therefore a large number of photons will not travel on 
a straight path between the Cherenkov light emission 
point and the detection location. On the contrary in 
ANTARES (and similarly in ORCA), the photons are 
detected un-delayed. This is the main reason why Ice- 
Cube has worser angular resolution than the ANTARES 
detector. Therefore, we consider ^ values in a range 
reflecting common angular resolutions achieved in water 
and by a sparse array in ice. Note, however, that one 
reasonably expects a substantially improved angular res- 
olution in ice with a smaller and denser array (PINGU), 
i.e. a global reduction of scale: in this case the short 
scattering length will be of relative importance and many 
Cherenkov photons will reach the optical modules closest 
from their emission point rather undelayed. 

The angular resolution of an event with 60 hits is about 
5° in IceCube and better than 2° (nhit/GeV ~ 1.5) in 
ANTARES. Therefore 15° < ^ < 30°. The range 1 < 
n hit /GeV < 3 leads to 8.5° < ifj < 40°. 

The smearing function for the zenith angle of muon, 
), can be computed using the smearing function 



for ip (38) as 



9^ 



^ J\6 



~ S >1 



(39) 



The denominator here appears similarly to that at the 
variable change (j) — >• c v performed in Eq. (29). The func- 



tion g{c^Cp) is normalized, which follows from normal- 
ization of g^. 

Fig. [3] shows the angular smearing function ^(c M ,c M ) 
for ipo = 15° and several values of c M . Notice that 
#-0( c /z 5 C/z)£/2 is not symmetric and it increasingly de- 
viates from the normal distribution, when approaching 
U = 180°. 
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FIG. 3: Angular smearing function in cosO^ for — 15° and 
several values of c u . 



B. Distributions with experimental smearing 

We calculate the distribution of events smeared over 
the experimental resolution functions. We convert the 
3-D distributions in the parameter space E v — y — c M into 
observed parameters space Q^^E v ^y convoluting n with 
the resolution distributions for E V1 y and ip: 



- IH,NH (7{ ^ ~x 



^9 NH (0^E u ,y) * (g^ g y g v ). 



The convolution is performed sequentially in order indi- 
cated in the last brackets. The smearing functions are 
taken according to Eqs. (35), (39) and (37) (the width 



th,nh , . i 
n v £ outside 



of Gaussian function for g y ). Values of 
region 1 < E u /GeV < 20 and for 0^ < 90° are set to the 
values taken at the boundaries. 

Integrating over the bins, we obtain the binned oscil- 
logram: 



bin(ijk) 



dCfj,dE u dy n^ NH (<9 M ,E„,y). 



The smeared distributions in the plane E v — cos ^ for 
different intervals of y and different resolutions are shown 
in Figs. [4j [5) § 

In comparison with Fig. [2j the overall scale of asym- 
metries is reduced by factor of ~ 2, which quantifies the 
effect of experimental smearing. Position and shape of 
the regions of strong asymmetry follow to a large extent 
those in Fig. [2] 



C. Estimations of the total significance 

Total significances with the experimental smearing are 
calculated using Eqs. ( 33p4 ) with replacement n — » 
n. Table [T] presents the total significance after one year 
of exposure for several experimental resolution scenarii, 
including the one with only kinematical smearing. 

For comparison we also compute the significances 
obtained immediately from the neutrino oscillograms, 
which corresponds to exact reconstruction of the 
neutrino energy and direction. If v and v distribu- 
tions are measured independently, we would have 
l^totl = 46.8, \S" ot \ = 43.8, and the total significance 



IStotl = Vl^otl 2 + l^otl 2 = 64.1. The latter is about 
3 times larger than the total significance in the case 
when v and v signals are not separated IS^^I = 23.7, 



in agreement with our qualitative result in sect. Ill 



In the realistic case of partial separation of the v and 
v signals, which takes place when information is in- 
cluded, and after the kinematical smearing the signifi- 
cance decreases strongly: down to 8.43 after one year (so 
that after 3 years of exposure we would have \S\ 
14.6). This number further reduces down to \S\ 



'3 yri 



3yri 
tot I 



6.1 
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FIG. 4: The hierarchy asymmetry distribution in the (E v — cos# M ) plane for different intervals of the inelasticity and for 
1 year of exp osure. The experimental smearing of the distributions was performed with the energy and angular resolutions 
a E V0.7E, 20°. 



after the experimental smearing in our worst case see- role in degrading these results, as the measurements are 
nario (ct^h = y/Q-^E^h, cr^ = 40°). differential from neighboring locations (bins in E v and 

c M ), and the systematic uncertainties between neighbor- 
Systematic uncertainties likely play a relatively mild 
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FIG. 5: The same as in Fig. [i] with a E = V0.7E, and = 40°. 



ing bins with different asymmetries are strongly corre- 
lated. In addition, the ^-distribution must be a superpo- 
sition of the ^/-distributions of neutrino and of antineu- 
trino events, strongly constraining its shape and provid- 
ing information related to the systematic effect in the 



y— dimension. However, we have also found negligible 
degradation of the significance (about 1%) if introduced 
as in [9 , at level of 10%. This is due to the small bin size 
of our oscillograms. 

Fig. [7] shows the dependence of the significance on the 
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FIG. 6: The same as in Fig.[i]with a E = V0.35E and = 10°. 
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^y0^35E^h and ipo — 20° and for kinematical smearing 
only. The dashed curves are for y— integrated signifi- 
cances. 

According to Fig. [7| the increase of the significance 



is sustained up to higher y for curves including exper- 
imental smearing. This is due to the contribution to 
the asymmetry from larger E v , whose relative impor- 
tance in smearing decreases. Also the difference between 
y— differential and integrated significances is relatively 
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TABLE I: The total significance of identification of the neu- 
trino mass hierarchy for different experimental smearing sce- 
narios and for 1 year of exposure. S'tot refers to analysis with 
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FIG. 7: Dependence of the significance on the upper limit of 
integration over y. Thin and thick curves respectively cor- 
respond to kinematical smearing only and the experimental 
smearing added. Solid and dashed curves respectively show 
Stat and SlU 



small after the experimental smearing. 



D. Ara§2 degeneracy 

The effect of an inversion of the mass hierarchy (espe- 
cially at large energies) is rather similar to a shift of the 
oscillation probabilities in the energy scale (see [9 j). This 
is equivalent to a change of Am| 2 . Therefore the effect of 
hierarchy can be partly mimicked by a change of Am^. 
Indeed, the pattern of distribution of the quantity 



7V NH (A' 



m 



32 



• S) — 7V NH (A 



m 



32) 



ViV NH (AmI 2 ) 



(40) 



in E v — c M plane is rather similar for certain values of the 
shift parameter, 5, to the hierarchy asymmetry pattern: 

7V IH (Am| 2 )-7V NH (Am| 2 ) 



v /A^ NH (AmI 2 ) 



(41) 



Since Am| 2 is known with some error, this parameter 
degeneracy degrades the sensitivity to the mass hierarchy. 
To quantify the effect the following significance has been 
computed in [9]: 



7V IH (Am 2 



32 



s) 



iV NH (Am§ 2 



v/JVNH(Am§ 2 ) 



(42) 



where 5 has been considered as a free parameter. This 
would correspond to NH as the true hierarchy and Am§ 2 
as the true value. The true distribution N Nil (Am^ 2 ) 
is then fitted by IH distribution with arbitrary values of 
Ara§ 2 . It has been found in [9] that the minimum S^^ -5 
is reached for S « — 0.5a(Ara3 2 ), where a(Aml 2 ) is the 
present la accuracy of determination of Am| 2 from the 
global fit [17 j. The minimal value (for 1 year of exposure 
and no inelasticity information) S^^~ 6 =3.8 should be 

J _ ' mm 

compared with S (5 = 0) = 6.0, thus showing re- 
duction of the significance by a factor 1.6. 

Future measurements at accelerators will reduce the 
error by factor of 2, which means that no significant im- 
provement is expected. 

Let us show how information about inelasticity (or us- 
age of 3D distributions) may help. As we mentioned 
before, the effect of a Am 2 2 change is nearly the same 
for neutrinos and antineutrinos, whereas ?/— distributions 
are different. 

We construct the distribution S 5,mt and the residual 
asymmetry plot S s,mt — S MR,mt which can be rewritten 



according to (40) and (41) as 



S 



(5,int 



7V IH (Am§ 2 ) 



AT NH (Am| 2 



vW NH (Am§ 2 ) 



Am 2 2 this residual 



After substitution (Am| 2 — S) — >> 
asymmetry essentially coincides with the quantity 5 MH_d 
(42) computed in [9]. 

On the left panels of Figs. [8] and [9j we respectively 
show the plots for the asymmetry S int and for the residual 
asymmetry S 5,int — S int for an ideal detector after kine- 
matical smearing only. We take S ~ — 0.5a(| Am| 2 |) = 
— 6-10 -5 eV 2 , which corresponds to the maximal degener- 
acy effect according to [9 j. On the right panels of Figs. [8] 
and [9J we present respectively the asymmetry S int and 
the residual asymmetry S 6,int — S int after app licati on of 
the experimental smearing. We used cfe = V0.7E, and 
^0 = 20° as a realistic experimental resolution. 

The total significance of determination of the mass hi- 
erarchy can be computed using the residual asymmetry 
as 



•sr.KMii - s) = { j \ &e v j dc^s^ - 

for the distributions without ^—information, and 



5 to t(MH -S) = ^JdE u J d C/i J dy(S* - S) 2 

with y— distribution. For S ~ — 0.5cr(| Ara 2 2 |) and after 
1 year exposure we obtain #jSt( MH ~ s ) = 4 - 23 - This 
should be compared with S^St = 7. 11 without degener- 
acy effect (see Table |l|. So, the degeneracy effect found 
in such a way corresponds closely to the one found in 
0. With the ^/-distribution, we obtain S^~ 6 = 6.03 
(5tot = 8.43). Thus, the total significance is enhanced by 
~ 43% using the inelasticity. 
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FIG. 8: Asymmetry plots S int with the kinematical smearing only (left) and after application of the experimental smearing 
cte — V0.7E, cr^p = 20°. 7 ^ E - (right), for 1 year of exposure. 
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FIG. 9: Residual asymmetry plots (S ,tn — S tn ) with the kinematical smearing only (left) and after application of the 
experimental smearing oe — V0.7E, — 20°. (right), for 1 year of exposure. 



After the experimental smearing described above we 
find 

^1(MH - S) = 1.93, S t ot(MH - 6) = 2.42 

(without degeneracy we would have SJSt = 3.87 and 
Stot = 4.19, see Table III). The significance enhancement 
is reduced to about 25%. 

These results mean that the necessary exposure to as- 
certain the mass hierarchy with an ideal detector is a 
factor 2 larger if y is not exploited. For the detector with 
the above mentioned experimental resolutions, this fac- 
tor is not as large but still significant, about 1.55. The 
additional relative power of the inelasticity, as we already 
noticed from numbers in Table [TJ is greater, when detec- 
tor resolutions are better. 



VI. DISCUSSION AND CONCLUSIONS 

Multi-megaton scale under-ice and under-water detec- 
tors of atmospheric neutrinos with low (few GeV's) en- 
ergy thresholds open up new possibilities for the determi- 
nation of neutrino properties. This includes the neutrino 
mass hierarchy, the deviation of the 2-3 mixing from max- 
imal and high accuracy measurement of Am^. 

With a dense array of optical modules, it will be pos- 
sible to identify different atmospheric neutrino events, 
and in particular, the CC events and determine their 
characteristics. For the events, it will be possible to 
measure not only the energy and the direction of the 
muon, but also the energy of accompanying hadron cas- 
cade. The latter then determines the inelasticity. With 
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2/, one can construct the three-dimensional distributions 
of events in {E v , cos 6^ , y) . 

In this paper, we have explored various improvements 
of sensitivity to the mass hierarchy, which will be possible 
with the inclusion of the inelasticity in the analysis. The 
results can be summarized in the following way. 

1. Inelasticity measurements provide a certain sensitiv- 
ity to separate signals from neutrinos and antineutrinos. 
This, in turn, reduces the cancellation of the neutrino 
and antineutrino contributions to the hierarchy as well 
as to CP-violation effects. 

We find that, in the ideal case of complete separation or 
independent measurement of v and v signals, the signifi- 
cance of the hierarchy determination increases by factor 
~ 2.2 — 3. However, finite accuracy of the separation (ex- 
traction of the parameter a) reduces the effect down to 
(20 - 30) %. The best separation is in the range of large 
y where, however, the angular smearing becomes strong 
and effect of mass hierarchy is averaged out. 

2. The selection of events with small y allows one to re- 
duce the angle between the neutrino and muon directions 
and therefore reduce the kinematical smearing, which is 
very strong at low energies in the resonance region where 
effect of mass hierarchy at the probability level is the 
biggest one. However, for small y, the effective separa- 
tion of the v and v contributions worsen, and moreover, 
the statistics decreases with cut in y. So, for fixed expo- 
sure, the overall gain is rather modest. 

Separation of the v and v improves with increase of y, 
while the neutrino angle reconstruction improves with de- 
crease of y. Therefore the analysis of these improvements 
should be done simultaneously. This requires study of 
the 3D distributions of events, which takes into account 
both separation and reduction of kinematical smearing 
automatically. 

3. We have computed the 3D oscillograms of the 
events with the kinematical smearing (for this the kine- 
matics of the v ^ CC-interactions has been taken into ac- 
count precisely). We then found the 2D asymmetry dis- 
tribution in the E v — cos 6^ plane for different intervals of 
y. The main contribution to the identification of the hi- 
erarchy follows from the intermediate range y = 0.3 — 0.7, 
and the contributions from intervals y = 0.8 — 1.0 and 
y = — 0.2 are small. The inelasticity enhances the to- 
tal significance of determination of the mass hierarchy by 
about 20%, which is consistent with our semi-qualitative 
analysis provided that a slight decrease of 7 is achieved. 

4. We then performed smearing of the distributions 
over the observables: the energies of muon and cascade 
as well as the angle of muon. We used the Gaussian 
smearing functions assuming different widths and their 
dependences on energy. The experimental smearing fur- 
ther diminishes the total significance by factor 1.5 - 2.4 
depending on the energy and angular resolutions. The 
inclusion of the inelasticity leads to an increase of the 



total significance by (8 — 11)% after application of the 
experimental smearing: The stronger the smearing, the 
weaker the significance increase. 

5. Inversion of the mass hierarchy and varia- 
tions of other parameters have different effects on the 
y— distribution of events. This means that inelasticity 
measurements will alleviate the degeneracy of the hier- 
archy with #23 and Am^. Without y distribution the 
degeneracy with Am^ reduces the significance by fac- 
tor ~ 1.7. The inelasticity measurements increase the 
total significance by 43% before the experimental smear- 
ing and by 25% with a specific reasonable experimental 
smearing scheme. 

6. The mass hierarchy and the systematic errors affect 
the y distribution differently. Therefore measurements 
of inelasticity will likely help to reduce the impact of 
systematic uncertainties. 

7. The contamination of the v ^ event sample with 
other flavors leads to a suppression of the oscillation ef- 
fects. The selection of events with not too large y will 
help discriminate CC events from event of other types 
and therefore mitigate the loss of features in the oscilla- 
tory pattern. 

8. All in all, we expect that the inclusion of the inelas- 
ticity of the interaction in the analysis will increase the 
significance by (20 — 50)%, which is equivalent to an in- 
crease of the exposure time or effective volume by factor 
1.5 - 2. 

9. It is not excluded that more sophisticated analysis 
will lead to even stronger enhancement effect. 

The next step in enhancement of the discovery poten- 
tial of the Multi-megaton scale detectors could be related 
to some information about the direction of the cascade 
using detailed time information about development of 
event. Also the inclusion of other type of events (cas- 
cades without muons) in the analysis will reinforce the 
discovery potential. 

The inclusion of the inelasticity as an ingredient in the 
data analyses may become necessary in order to unam- 
biguously conclude on the mass hierarchy in the near 
future. 
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Appendix A: Variable change (f) — )> c u 



®v — 0/z + P- We use the matrix to generate revolution 
vector set (</>)}(/> around the muon trajectory, 

-CcfyS^Sp + C^Cf3 ) 

The z-component of the vector v can be associated to c Vl 
c v = —c^s^sp + c^cp therefore d<j) = dc v / sps^s^, with 



Appendix B: Smearing function for y 
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FIG. 10: The reconstructed ^/-distribution for two different 
sets of {E^jEh} (numbers at the curves) and cr^^h = y/E^h- 
The dashed curves correspond to the Gaussian approxima- 
tion. 



We use the notation A /x = E fl — E fl , A h = E h - E h 
and the simplified relation y = Eh/(E^ + Eh). In order 
to obtain the y— distribution, we introduce z = E^/E^, 
so that y = 1/(1 + 2). Consequently, z = 1/y — 1 and 
dz = —dy/y 2 . Let us denote by P z (z) the distribution of 
z. Then the distribution is given by 



Consider a muon with vector /x = (s M , 0, c M ). The ma- 1 
trix associated to the rotation <j> around the H axis is ~2*Ml/»-l)- 



Ru,(<t>) = c u s cf> c —SchSa . In turn, the distribution of ratio z can be found from 



We consider a neutrino vector i/q at an angle /3 also in the 
plane x — z. A possible vector is uq = (s^, 0, c^), with 



Pz(z) = J g h (E h ,E h )g^E^E^sf^-z^ dE h dE^. 
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The integration gives The y distribution obtained in this way is nearly Gaus- 

sian in most cases of interests. It starts to deviate from 



Gaussian, showing enhanced tails, when and Eh are 

pJz) = 6 h ^ both small. This is illustrated Fig. 10 for the energy 

2tt (a 2 + a^z 2 ) 2 lA^a 2 + A h a*z\ resolution widths a^ h = y/E^ h . 



V^e 2 <4^4^ (Ay h + A^z) 



a 2 z 2 erf 




